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- The MAILING DATE of this communication appears on the cover sheet with the correspondence address- 
All claims being allowable, PROSECUTION ON THE MERITS IS (OR REMAINS) CLOSED in this application. If not included 
herewith (or previously mailed), a Notice of Allowance (PTOL-85) or other appropriate communication will be mailed in due course. THIS 
NOTICE OF ALLOWABILITY IS NOT A GRANT OF PATENT RIGHTS. This application is subject to withdrawal from issue at the initiative 
of the Office or upon petition by the applicant. See 37 CFR 1.313 and MPEP 1308. 

1 . ^ This communication is responsive to 6/26/2006 . 

2. ^ The allowed claim(s) is/are 1,4-6 and 8-23 . 

3. □ Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 1 19(a)-(d) or (f). 

a) □ All b)DSome* c) □ None of the: 

1. □ Certified copies of the priority documents have been received. 

2. □ Certified copies of the priority documents have been received in Application No. . 

3. □ Copies of the certified copies of the priority documents have been received in this national stage application from the 

International Bureau (PCT Rule 17.2(a)). 
* Certified copies not received: . 

Applicant has THREE MONTHS FROM THE "MAILING DATE" of this communication to file a reply complying with the requirements 
noted below. Failure to timely comply will result in ABANDONMENT of this application. 
THIS THREE-MONTH PERIOD IS NOT EXTENDABLE. 

4. □ A SUBSTITUTE OATH OR DECLARATION must be submitted. Note the attached EXAMINER'S AMENDMENT or NOTICE OF 

INFORMAL PATENT APPLICATION (PTO-152) which gives reason(s) why the oath or declaration is deficient. 

5. □ CORRECTED DRAWINGS ( as "replacement sheets") must be submitted. 

(a) □ including changes required by the Notice of Draftsperson's Patent Drawing Review ( PTO-948) attached 

1) □ hereto or 2) □ to Paper No./Mail Date . 

(b) □ including changes required by the attached Examiner's Amendment / Comment or in the Office action of 

Paper No./Mail Date . 

Identifying indicia such as the application number (see 37 CFR 1 .84(c)) should be written on the drawings in the front (not the back) of 
each sheet. Replacement sheet(s) should be labeled as such in the header according to 37 CFR 1.121(d). 

6. □ DEPOSIT OF and/or INFORMATION about the deposit of BIOLOGICAL MATERIAL must be submitted. Note the 

attached Examiner's comment regarding REQUIREMENT FOR THE DEPOSIT OF BIOLOGICAL MATERIAL. 



Attachment(s) 

1 . □ Notice of References Cited (PTO-892) 

2. □ Notice of Draftperson's Patent Drawing Review (PTO-948) 

3. BJ Information Disclosure Statements (PTO/SB/08), 
' Paper No./Mail Date J]zl£r02~ 

4. □ Examiner's Comment Regarding Requirement for Deposit 

of Biological Material 



5. □ Notice of Informal Patent Application 

6. □ Interview Summary (PTO-413), 

Paper No./Mail Date . 

7. □ Examiner's Amendment/Comment 

8. ^ Examiner's Statement of Reasons for Allowance 

9. □ Other . 
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DETAILED ACTION 

1 . This action is responsive to amendment filed 6/26/2006. 

2. The disposition of the claims is as follows: claims 1, 4-6 and 8-23 are pending in the 
application. Claims 1, 1 1 and 14 are independent claims. Claims 2, 3 and 7 have been cancelled. 



Claim Rejections - 35 USC § 112 

3. In view of the amended claims, 1 12 rejections are withdrawn. 

Claim Rejections - 35 USC § 102 and 103 

4. In view of amended and cancelled claims and review of cited references, 102 and 103 
rejections are withdrawn. 



Allowable Subject Matter 

5. Claims 1, 4-6 and 8-23 are allowed. 

6. The following is an examiner's statement of reasons for allowance: 
Applicant's independent claims 1,11 and 14 stand novel over the related prior art. 
While the related art of Seni et al. (U.S. Patent Publication 2003/0007018), hereinafter 

Seni, does make use of handwriting recognition of text, Seni does not disclose: 

"converting the digital ink image into multiple structured object representations, the 
multiple structured object representations representing at least a first image representation having 
formal structured object representations, and a second image representation containing informal 
structured object representations" and 
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"altering the digital ink image into multiple simultaneously existing structured 
alternative interpretations of the digital ink image each of the alternative interpretations 
being plausible intended outputs of a user" as claimed in independent claim 1 . 

Nor does Seni teach "each of the structured object representations correlating to a 
perceptually salient structure of the digital ink image defined by the converter, each perceptually 
salient structure including text and line art, wherein each of the structured object representations 
is editable by a structured text/graphics editor and the converter further configured to alter the 
digital ink image into multiple simultaneously existing structured alternative interpretations of 
the digital ink image, each of the alternative interpretations being plausible intended outputs of a 
user" as claimed by independent claim 11. 

Furthermore Seni also lacks the teaching of "structured object representations of a digital 
ink image, each structured object representation correlating to an automatically defined 
perceptually salient area of the digital ink image, wherein each of the structured object 
representations is editable by the structured text/graphics editor to allow a user to generate 
multiple alternative interpretations of the digital ink image, the multiple alternative 
interpretations simultaneously existing structured alternative interpretations of the digital ink 
image, each of the alternative interpretations being plausible intended outputs of a user" as claim 
in independent claim 14. 

Therefore as claimed by the combined elements of amended independent claim 1,11, and 
14, the cited reference and prior art of record lack separately and in combination the elements of 
amended claims. 
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Claims (4-6, 8-10), 12-13, and 15-23 depend from allowable independent claims 1,11 
and 14, respectively, and therefore are also allowed. 

7. Any comments considered necessary by applicant must be submitted no later than the 
payment of the issue fee and, to avoid processing delays, should preferably accompany the issue 
fee. Such submissions should be clearly labeled "Comments on Statement of Reasons for 
Allowance." 

Responses 

8. Responses to this action should be mailed to: Commissioner of Patents and Trademarks, 
Washington, D.C. 20231. If applicant desires to fax a response, (703) 872-9306 may be used for 
formal communications. 

Inquiries 

9. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Gregory F. Cunningham whose telephone number is (571) 272- 
7784. 

I f attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Kee Tung can be reached on (571) 272-7794. The fax phone number for the 
organization where this application or proceeding is assigned is 571-273-8300. 
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Information regarding the status of an application may be obtained from the Patent 
Application Information Retrieval (PAIR) system. Status information for published applications 
may be obtained from either Private PAIR or Public PAIR. Status information for unpublished 
applications is available through Private PAIR only. For more information about the PAIR 
system, see http://pair-direct.uspto.gov. Should you have questions on access to the Private PAIR 
system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). 
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